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Abstract 

Adult neurogenesis has long been documented in the vertebrate brain, 
and recently even in humans. Although it has been conjectured for many 
years that its functional role is related to the renewing of memories, no 
clear mechanism as to how this can be achieved has been proposed. We 
present a scheme in which incorporation of new neurons proceeds at a 
constant rate, while their survival is activity-dependent and thus contin- 
gent upon new neurons establishing suitable connections. We show that 
a simple mathematical model following these rules organizes its activity 
so as to maximize the difference between its responses, and can adapt to 
changing environmental conditions in unsupervised fashion. 
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1 Introduction: 



The function of the mature brain is not only to be constantly ready to solve 
particular tasks, but also to learn new ones, adapt to changes in environmental 
conditions, and optimize its computational resources accordingly. While synap- 
tic change is regarded as the most common form of modification underlying 
plasticity (notably in neural network models), it is by no means the only source 
of functional change in the brain. One alternate source is adult neurogenesis, 
i.e. the incorporation of new neurons into neural structures that have already 
passed through development. 

It was long thought that neuronal production ended soon after birth, fuel- 
ing a view of the adult brain as a finalized structure (as far as new neurons 
are concerned), with further plasticity concentrated on synapses. It took some 
time to realize and demonstrate that neuronal incorporation can, to different 
degrees, continue during the entire life of an animal. De-novo neuronal incor- 
poration continues in the adult mammalian brain in the dentate gyrus of the 
hippocampus, the olfactory bulb and the association cortex ||, ^, ^, ||, ^. 
Adult neurogenesis also occurs extensively in birds and other vertebrates |0, ^ . 

Based on the experimental evidence, it has been conjectured that adult neu- 
rogenesis could be related to brain plasticity and learning |^, |ll|, [l3| . 
However, the functional mechanism of neuronal replacement remains elusive, 
and we do not understand the degree to which it may supersede, compete with 
or complement better understood plastic mechanisms. The observation of sea- 
sonal changes of neuronal incorporation and death in canaries, as they renew 
their yearly repertoire of songs, has led to the idea that neurons are not in- 
definitely plastic but that new neurons are needed for new memories. Despite 
the considerable interest and importance of the phenomenon, no clear mecha- 
nism has been described through which this memory renewal process would be 
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implemented. 

We describe here a simple model in which adult neurogenesis underlies unsu- 
pervised learning and adaptation in sensory processing. We chose the olfactory 
bulb (OB) as the neuroanatomical locus of the model, for adult neurogenesis has 
been extensively documented in this system, and the neuronal processing tasks 
are presumably better circumscribed than in other sensory systems jli). The 
olfactory bulb is the first realy of the olfactory information. Olfactory receptor 
neurons express a single olfactory receptor and project to two glomeruli of each 
bulb in a topographically precise manner H^. Each receptor may be acti- 
vated by more than one odor and each odor may activate more than one receptor 
H^. Mitral and tufted cells (M/T), the output neurons in the bulb, receive 
their synaptic input from the olfactory receptors within single glomeruli. Odor 
information seems to be encoded in the spatial as well as the temporal responses 
of M/T cells. Olfactory discrimination is then dependent on the combinatorial 
pattern of activation of multiple M/T cells. Given the promiscuous nature of 
olfactory receptors, the discrimination of odors is importantly dependent on the 
tuning of the combinatorial response of M/T cells. 

The activity of M/T cells is regulated by inhibitory granular cells. Granular 
cells are unpolarized neurons that establish inhibitory dendro-dendritic connec- 
tions with the M/T cells long secondary dendrites ||2^, and are indeed thought 
to play an important role in lateral inhibition and in the tuning of M/T cell 
responses to different odors |Q. Each granule cell connects to several mitral 
cells that can be far away fron each other given the extensive lenght of their 
secondary dendrites. Experimental results indicate that only inhibitory neurons 
are replaced in the OB. Whereas M/T cells are born before birth, the large ma- 
jority of granular neurons continue to be born postnatally and into adult life 

[0- 
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Based on the known anatomy and physiology of the OB, we modelled neuro- 
genesis in this structure. It is important to remark that we are not presenting an 
exhaustive model of olfaction |[l5j , which would require a delicate understanding 
of the temporal dynamics of encoding |[l6j, but rather using it to demonstrate 
the computational potential of neurogenesis for information processing. 

Model 

We base our model on two fundamental observations. First, neuronal produc- 
tion in the sub-ventricular zone (SVZ) and migration toward the OB continue 
even in the absence of the bulb j^; this suggests that cell birth and migra- 
tion are not dependent on olfaction or activity within the bulb Second, 
most newly incorporated neurons die promptly, suggesting that those that do 
survive have achieved some elusive goal Neuronal activity is known 

to be necessary for survival during brain development but not for the initial 
synapse formation[^ |2^. Moreover, activity-dependent mechanisms also seem 
to play an important role in the recruitment or survival of postnatally generated 
OB interneurons p3| , [24| . These findings suggest that the survival of the 
newly-generated neurons is regulated through activity. 

Thus we postulate the basic mechanism of the model: neuronal incorporation 
proceeds at a constant unregulated rate, whereas neuronal survival is modulated 
through activity-dependent apoptosis. New neurons arrive and establish ran- 
dom connections; those with useless connections fail to participate in relevant 
processing and soon die off, but neurons that establish useful connections in the 
context of the network can survive and are therefore incorporated into the final 
structure. Exactly which feature of neuronal activity ensures survival can then 
dictate the final function of the network. 

The simplest model compatible with the experimental evidence consists of 
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Fi gure 1: Simplified anatomy of the Olfactory Bulb used in the model. The vector x 
represents the activity of the receptor layer R, and y the activity of the mitral cell layer M/T. 
Granular inhibitory cells G establish pairwise connections with the mitral cells. 

a layer of glomeruli receiving one-to-one projections from an input or receptor 
layer and local lateral inhibition due to granular interneurons. The output of the 
system then equals the input minus the effect of inhibitory connections between 
the outputs: 

y(fe) = xC^) - Gyt'^) (1) 

where y^*^) is the activity of the output layer, x^'^^ is the activity of the receptor 
layer when presented with input fc, G is a matrix giving lateral inhibition, and 
{Ui is the activity of glomerulus number i, Fig. 1). Solving for y we obtain 

yW = (l + G)-ixW (2) 

We assume that each granular cell has connections to only two projection neu- 
rons [Q; therefore, G^ is the density or number of granular neurons connecting 
M/T cells (or glomeruli) i and j, so that Gy = Gji (connections are sym- 
metric) and Gii = Vz, (there is no self-inhibition). We also assume that the 
response of each M/T cell is normalized by the total number of synaptic con- 
nections jsij and that neuronal responses remain in the linear regime; positive 
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or negative activity should be interpreted in the context of a background level. 
Eq. 3 can then be rewritten as 

which is expHcitly normahzed by total synaptic weight. We finally assume for 
convenience that the output layer is normalized, || y^*^^ ||= IVfc. 

We assume that only interneurons are replaced, arriving at a constant rate 
with randomly distributed connectivity. The regulation of the survival rate of 
the interneurons is implemented as a function of their activity, which indicates 
how well they are connected to active output cells, so that active cells survive and 
inactive cells do not. Our key assumption is that the survival of the granular 
cells depends on the product of the inputs, so that granular cells connecting 
glomeruli i and j will survive if the value of HiVj, averaged over the time of 
presentation of the entire set of stimuli, is greater than or equal to zero; this 
amounts to a somatic coincidence rule. Thus, when {yiUj) ^ all newly arrived 
neurons survive, and so AGjj has its full value; while {yiUj) < results in 
massive death and AGy < 0. This leads to a simplified update equation given 
by 

AGij {yiVj), (i^j) (3) 

where () denotes the average over the ensemble of inputs k = 1...N. A non- 
hnearity is introduced through the condition that G be positive definite, Gij > 
Oi ^ j, i.e. the population of granular cehs cannot be negative. 

Results 

Based on the previous considerations, we implemented a simulation of the pro- 
cess of training the network with the activity based replacement of the inhibitory 
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interneurons. The left panel of Fig. 2 shows a set of 10 odors represented as 
different mixtures of receptor bindings. The right panel shows the result of 
iterating a cycle of presentation of the set of odors followed by neuronal replace- 
ment on a model network with 10 M/T cells. The result of the update rule 
specified by Eq.||is to orihogonalize the output, which can be seen by analyzing 
the fixed point of the system: Ay = AGy = {ViVj) — OVi, j and given 
the normaHzation of y^, {yiHj) ~ I, where I is the identity matrix. The simu- 
lation displays a very sharp orthogonalization of the output vectors, which can 
be further appreciated in the evolution of the response to a single odor (Fig. 3). 
The orthogonaHzation of the output maximizes, to linear order, the separation 
between output vectors and is the simplest way of achieving discrimination. An 
orthogonal set of neural responses is robust to the presence of noise because the 
representatives are maximally distant from each other [|5|. In this case, an or- 
thogonal set of responses from the output of the M/T cell layers corresponds to 
the maximal difference in the the spatial response in the layer for each odor. So 
it is possible to implement a simple algorithm based on neurogenesis and neu- 
ronal replacement that achieves a complex mapping of input stimuli in neural 
space. 

To quantify the orthogonalization process, we computed the determinant of 
the 10 X 10 matrix of odors and M/T cells (see Methods). The evolution of the 
determinant and the total number of granular cells incorporated are depicted 
in Fig. 4, together with the rate of incorporation, as a function of the iteration 
number. 

The other functional property of the algorithm is its adaptability to changes 
in the input ensemble, i.e. a change in the set of odors the network is presented 
with. This is a feature of paramount importance for early odor sensory process- 
ing, given the intense seasonal changes produced, e.g., by blooming, migration 
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Figure 2: Representation of the smell matrix before and after application of the proposed 
algorithm. Left panel: an instance of odor ensemble with different degrees of mixing between 
receptors. Right panel: result of application of the algorithm; the mitral cell layer organizes 
to segregate topographically the outputs. 



Figure 3: Evolution of the mitral cell layer response to one odor. 
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Figure 4: Evolution of the network. Initially, the mitral cell layer matrix determinant equals 
the small odor matrix determinant. As the algorithm advances, the determinant (circle) as 
well as the total number of granular cells in the network (solid line) grow until a plateau 
is reached, after which the incorporation slows (dotted line, representing the derivative of 
granular cell incorporation) and finally approaches zero. 

and foraging, and because the presence of a single odorant in higii concentrations 
is enougii to upset the output of a system like the OB, due to the promiscu- 
ous nature of the olfactory receptors. In our model, training is unsupervised, 
and consists simply of exposing the system to the environment until a balance 
between cell incorporation and death is estabhshed. Continued exposition to 
a constant environment does not result in over-training. If the environment is 
changed, the balance is upset and the system evolves until a new balance is 
achieved. To see how our model copes with a changing environment, we simu- 
lated a periodic renewal of the odor ensemble, on a time-scale similar to that of 
the convergence of the orthogonalization process. The initial update rule was 
modified to include a slow death process. 



where /i^j is a stochastic variable representing a constant rate of unregulated 
and non-specific death, independent for each granular unit, /iy = /2 The 



(4) 
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results can be appreciated in Fig. 5, which depicts the evolution of the output 
determinant, the total number of granular cells, and the number of granular 
cells connected to one arbitrary pair of glomeruli. After the initial rise, the total 
number of granular cells remains relatively constant during ensemble changes, 
whereas any one particular location in the granular network fluctuates more 
tightly with the changes. The orthogonalization process, although dependent 
on the identity of the ensemble, is basically unaffected by the changes, as the 
determinant is increased several orders of magnitude. Importantly, the non- 
specific death term in the update equation, though small, is essential to assure 
adaptability. Its absence leaves the network prone to preserve traces of previous 
ensembles, which hinder the capability of orthogonahzing new ensembles (data 
not shown). 



Figure 5: Adaptation of neurogenesis to environmental changes. Each tick in the horizontal 
axis represents the exposure of the network to a new odor ensemble; the time axis is in a 
logarithmic scale which is reset after each new exposure. Symbols correspond to: solid line, 
total number of granular cells; circles, number of cells at one arbitrary position in the granular 
network; and squares, mitral cell layer matrix determinant. 
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Discusion 



We have modelled a simplified olfactory bulb circuit based on its known anatomy 
and physiology in witch granule cells are constantly replaced. We have shown 
that by having the young neurons to connect randomly and to survive in an ac- 
tivity dependent basis, as experimental evidence suggests, neurogenesis is capa- 
ble of maximazing the discrimination of odors in a unsupervised manner. More- 
over, this discrimination task is robust to a changing environment by adding a 
small random cell death rule. 

Several physiological considerations are in order here. In the first place, the 
implementation of the proposed survival rule implies only a local or somatic 
computation (for instance, a biochemical mechanism involving a high stoi- 
chiometry or cooperative reaction, such as the CamK-II/Ca++ pathway), and so 
requires much simpler molecular machinery than synapse-specific modification 
mechanisms [Q. One may think then that in evolutionary terms, the selection 
of different strategies of plastic modification may depend both on their com- 
putational possibilities and on ease of implementation, as well as accessibility: 
neurogenesis was already available to build the structure in the first place. 

The second consideration concerns the apparently hazaphardous distribu- 
tion of brain areas where adult neurogenesis has been documented. Although 
our model was not intended to solve this puzzle, it suggests a possible answer. 
The replacement of entire neurons is a rather violent event, in network terms, 
and rather unlike smoother and more gradual rules like Hebbian changes or 
back-propagation. The relationship between our algorithm and such gradual 
rules is similar to that between Monte Carlo methods and gradient descent. In 
the former, the minimization of an objective or cost function is done by ran- 
domly searching the configuration space and thus avoiding trappings in local 
minima, whereas the latter performs the minimization by downhill descent on 
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the steepest directions of the function. In these methods, the dimensionaUty 
and degree of smoothness of the function to be optimized plays a substantial 
role as to which performs best. Thus we hypothesize that the dimensionality of 
the input in competition with the amount of computational resources dedicated 
to a task is what determines the existence of adult neurogenesis. For instance, 
in the visual pathway there are several layers of processing before reaching the 
cortex, whereas the OB, whose input space has an intrinsic high dimensionality 
[ p^ , projects directly to the olfactory cortex. If synaptic plasticity is imple- 
mented by a diffusive substance, a trophic factor for instance, then the diffusive 
process coupled with the normal excursion of axonal and dendritic extensions 
can mislead the guidance process. This will be particularly true if very distant 
locations in the network must be connected, a very Hkely scenario in the case 
of olfaction, where statistical correlations in the input do not possess a smooth 
topographic projection, i.e. there is no simple sense of "neighborhood". Accord- 
ing to this hypothesis, the incorporation of new neurons can be correlated more 
precisely with changes affecting global aspects of the input statistics. 

We have presented the first mechanistic model in which adult neurogenesis 
provides the scaffold underlying a computational task, namely the orthogonal- 
ization of the neural responses to changing odor ensembles. The model predicts 
the differential incorporation of neurons in particular regions of the OB upon 
olfactory environmental changes, the necessity of a background of constant non- 
specific cell death, and the existence of a somatic survival signal dependent on 
activity. It also suggests that the structure of the input space determines to 
some extent the existence of this mechanism in particular brain areas, thus 
providing a series of predictions for future experimental manipulation. 
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Methods 

The update of the granular layer was computed from Eq. || with AGy = liViUj) 
where the average is computed over the cycle of presentations of the odors; 
7 = 5 X lO^'^ in all simulations. The steady-state solution is computed for 
each odor, and then normalized to \y\ = 1. The orthogonalization is quanti- 
fied in Fig. 4 by computing the rank-1 determinant Aq of the output matrix 

= {y*^}, where k ranges over the ensemble of odors. In general, is the 
determinant of the largest non-singular submatrix of A, This can be computed 
for any rectangular matrix from the singular value decomposition A = UAV, as 
A = Ha 7^0^"' o^'^ simulations has always dimension 10. The evolution of 
the total number of granular cells in the network shows a monotonic increase, 
although the incorporation rate slows dramatically after the stabilization of the 
orthogonalization is reached. For the purpose of this demonstration, the rate of 
non-specific death was kept equal to zero. For the simulation of Eq. § depicted 
in Fig. 5 the random death is defined as a stochastic variable which can take the 
values = 5 X 10^^ with probability p — 5 x 10^^ and p. = with probability 

1 — p in each iteration of the algorithm. 
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